United States Patent [w] 

Tiirockmorton et al. 



■MliiliifflBli™^ 



US005818441A 

[li] Patent Number: 
[45] Date of Patent: 



5,818,441 

Oct 6, 1998 



[54] SYSTEM AND METHOD FOR SIMULATING 
TWO-WAY CONNECTIVITY FOR ONE WAY 
DATA STREAMS 

[75] Inventors: John A. Throckmorton, Lake Oswego; 

Edward R. Harrison; Burt Perry, 
both of Beaverton, all of Oreg. 

[73] Assignee: Intel Corporation, Santa Clara, Calif. 

[21] Appl. No.: 490,822 

[22] Filed: Jun. 15, 1995 

[51] Int. CI. 6 H04N 7/10 

[52] U.S. CI 345/328; 348/13; 348/7; 

348/12 

[58] Field of Search 345/327, 328; 

348/7, 12, 13, 473, 714 

[56] References Cited 

U.S. PATENT DOCUMENTS 

5,347,304 9/1994 Moura et al 348/12 

5,499,046 3/1996 Schiller et al 348/12 

5,513,180 4/1996 Miyake et al 348/7 

5,583,864 12/1996 Lightfoot et al 348/7 

5,594,491 1/1997 Hodge 348/7 



5,613,192 3/1997 Ikami et al 348/9 

Primary Examiner — Victor R. Kostak 

Attorney, Agent, or Firm— Blakely, Sokoloff, Taylor & 

Zafman 



[57] 



ABSTRACT 



A system supplying information associated with a broadcast 
television program to a consumer such that said consumer 
perceives the associated data as the result of two way 
interactivity with external sources of data such as online 
services or the Internet. The system includes equipment for 
inserting the associated data into the vertical blanking inter- 
val of the television signal on the supplier side of the system. 
On the receiving side, the system includes a personal com- 
puter capable of receiving the television program and storing 
the associated data locally. The consumer may then interact 
with the stored associated data in an apparently two way 
interactive manner. Additional interactivity may be achieved 
by adding an actual two way communication channel to the 
personal computer so that online services or the Internet may 
be accessed. This two way communication channel is made 
particularly effective if the associated data contains pointers 
to locations in the online services or the Internet which are 
particularly relevant to the television program. 

42 Claims, 5 Drawing Sheets 
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SYSTEM AND METHOD FOR SIMULATING 
TWO-WAY CONNECTIVITY FOR ONE WAY 
DATA STREAMS 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

This invention relates to enhancing one-way broadcast 
data transmissions. More particularly, it relates to enhancing 
the quality and content of a primary information stream by 
creating and transmitting associated data which provides the 
appearance of an interactive connection to secondary 
sources of information. 

2, Background 

One of the limitations of nearly all forms of electronic 
mass media such as radio, television, audio CD's and video 
cassettes is that the communication of information or data is 
one way from the provider to the consumer. The character- 
istics of one way sources of data are that the data is sent 
sequentially and is fleeting or at best can be recorded for 
later playback. And a consumer cannot interact with the data 
provided to seek additional information or services. 

There is a desire by electronic mass media consumers for 
additional services, and providers of television and radio 
broadcast services are looking for new sources of revenue. 
In particular, consumers are looking for information or data 
that is related to what they are viewing in the media. The 
additional information may be in the form of details on the 
content of the current program such as the recipe of a meal 
being demonstrated on a cooking show or biographies of 
actors in a drama or historical background information on 
events depicted in a program. Or, it could be program 
highlights such as key plays from the baseball game. In 
addition, consumers would like access to real time data such 
as stock price, updated baseball scores as they occur, traffic 
and weather conditions. Also, consumers would like to have 
access to special services associated with product advertis- 
ing such as information on where to buy nationally adver- 
tised products — possibly with a map to the nearest location, 
or the ability to instantly receive coupons. 

Recently, online services such as provided by the World 
Wide Web of the Internet have become available. Such 
services provide access to immense amounts of data on an 
interactive basis by linking digital computers together over 
sophisticated communications networks. At the same time, 
the cost of digital computing power is falling rapidly. For 
example, many homes now have one or more computers. 
And home computers have displays capable of showing 
television as well as audio capability. They also have 
memory and computing power. 

But while such services are generally available and com- 
puters are becoming more widespread, finding relevant 
information is an arduous task that may take hours of 
searching even for an experienced user. 

In addition, these services require a 2-way connection 
from a consumer's location to the online network. In the 
consumer market, prolonged utilization of a single phone 
line for 2-way digital communications is expeasive. 

Up until now, there has been no way for producers of mass 
market broadcast programming to deliver data associated by 
its relevancy to its subject matter that could be interactively 
displayed and manipulated by consumers on a real time 
basis. What is meant by real time is that the consumer 
receives and has access to the relevant data during the 
process of program reception. Therefore the data becomes 
an integral part of the experience desired by the program 
producers. 
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Although received during a program, the information is 
retained and may be traversed by the consumer at a later 
time, as if they were connected in a 2-way fashion to an 
online service. 

5 3. Prior Art 

Perhaps the earliest effort to address the foregoing needs 
is for program content providers to include a telephone 
number in either the radio or television broadcast. The 
consumer is invited to dial a number for additional infor- 

10 mation. However, this telephone number is part of the 
primary data stream which is transitory. 

A second attempt is the provision of closed caption 
programming for the hearing impaired on television. This 
takes the form of written text appearing somewhere on the 
television screen typically at the bottom and requires a 
special decoder or mode set on the television. The text is a 
written rendition of the audio portion of the television 
program. That is, it is a recapitulation of the information 
supplied by the primary data provider and is not stored or 

20 saved for later access by the consumer. 

Television networks also use a part of the unused band- 
width in the video signal to send the schedule of programs 
coming up on that network. One network is sending a 

2S comprehensive program listing in digital format over an 
unused section of the NTSC bandwidth. This is called an 
electronic program guide ("EPG"). A second network uses a 
portion of the unused NTSC bandwidth to send digitally 
encoded stock quotes and the subject matter of the topics 

30 covered in the news broadcast, and extended data services 
("XDS") sends the date, time, name of a scheduled program, 
type of program and how much of the program remains. 
Cable services provide additional detail about songs being 
played on subscriber digital audio services such as digital 

35 music express ("DMX(tm)"); The detail typically consists of 
the name of the artist, the name of the song and the album. 
A system called Gemstar(tm), provides information in digi- 
tal format that enables consumers to record programs by 
referencing a number in a program guide. 

40 Many of the foregoing services are provided on broadcast 
television only over what is called the vertical blanking 
interval (the "VBI"). The VBI is a portion of the bandwidth 
defined for broadcast television and in the case of NTSC, for 
example, consists of the first 21 of the 525 raster lines that 

45 define a video frame. SECAM and PAL have a similar 
arrangement. Of the 21 lines, line 21 is divided into two 
frames of 60 hz bandwidth each. The closed caption is 
provided in the first frame of line 21. 

None of the foregoing allow a consumer to experience 

50 apparent interactivity with external data sources. That is, 
none provides data that persists for more than a few seconds 
and none allows the consumer to manipulate directly that 
data. 

55 SUMMARY OF THE INVENTION 

The foregoing problems may be resolved by a system for 
supplying a primary data stream and associated data to a 
consumer such that the consumer perceives the associated 
data as the result of interactivity with external sources of 

60 information. This system includes a creation unit for creat- 
ing the primary data stream and the associated data. The 
primary data stream and associated data are supplied to a one 
way delivery unit for delivering the primary data stream and 
the associated data to the consumer. At the consumer 

65 location, the system includes a receiver for receiving the 
primary data stream and a receiver for receiving the asso- 
ciated data. These may be the same unit. The system further 
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includes computer memory storing the received associated FIG. 1 is a block diagram of the invention at the highest 

data. A processor communicates with the memory for level of abstraction. Referring now to FIG. 1, data stream 

accessing the associated data. Finally, the system includes a creation unit 1 performs the function of generating both the 

user interface connected to the processor through which the primary data stream and the associated data stream. The two 

consumer may interact with the system. s data streams may or may not be merged to create a combined 

Tie method of the present invention includes the steps of stream °( F imarv and associated data. He two data streams 

, r c , . . c • * j are supplied to non-interactive delivery unit 2 which per- 

first generabng a stream of primary data and of associated & & ^ f ^ streams ^ 

data Next, both the primary data stream and associated data consumef ^ non . mteractive B delivery unit mchldes deliv . 

are delivered to me consumer. Next, both the primary data b broadcast, cable or a packaged media such as 

stream and the associated data are received at the location of » and audio CD>s ^ non . m(eractive deli is 

the consumer The primary data stream is rendered to the , Q indude aU Qn dec(IDnic da{a ^ 

consumer as it arrives. The associated data is stored in local ^ . , J A , „* M ' 

_ T . „ . . , , ... systems, 1 lie primary data stream and secondary data stream 

storage. Next the associated data is accessed by retrieving it ' t . ,„••.* t 'u*„a „ „ & ,1, ,i „ _ 

f 6 J 6 are typically transmitted to a consumer over the same 

irom oca memory, ^ delivery medium; however, the invention contemplates situ* 

BRIEF DESCRIPTION OF THE DRAWING ations where this is not the case For example the primary 

data stream could be delivered by broadcast television and 

The preferred embodiments of the invention will now be the associated data could be delivered over a high speed 

described in connection with the drawing wherein: digital network, a FM sideband, a direct satellite broadcast, 

FIG. 1 is a block diagram of the invention at the highest 2 o a cable network > a telephone, etc. 

level of abstraction. When the delivered data reaches receiver 3, it is decoded 

FIG. 2 is a block diagram showing further detail of the from its delivery medium. That is, if it is sent by broadcast 

entire system according to the present invention. television, the receiver decodes the signal, separates the 

HG. 3 is a block diagram showing additional detail of the P rim ^ data from ^ ******* ^ata and passes the asso- 

i * j .L. o< ciated data on to processor 4. Processor 4 may further 

system located with the consumer. 25 . , At . f A . , . . , J . . , 

decode the associated data and in any event supplies the 

FIG. 4 is a block diagram of a second preferred embodi- associated data to memory 5 where it is stored for future use. 

ment of the invention that includes interactive communica- ^ of thc primar y data stream may witn 

tlons * the associated data via user interface 6 such as a keyboard, 

FIG. 5 is a diagram showing additional detail of the 3Q mouse or voice activation electronics through which the 

system located with the consumer when interactive commu- consumer gives commands to processor 4 and which in turn 

nications are included. causes the associated data to be accessed and processed. The 

Mw „ „„„ _ resulting data is then supplied to display 7. 

DESCWPTI^OFTHEPREFERRED FIG. 2 provides additional system detail. Referring now to 

35 FIG. 2, reference numeral 10 refers to the primary data 

An electronic mass media provider may be said to deliver stream generating sub-system. The output of primary data 

a one-way stream of electronic data. This stream of data is stream generation sub-system 10 is typically an analog 

herein referred to as a primary stream of data and includes signal. However, it may be a digital signal as in the case of 

live or pre-recorded information that is created by the digital broadcast television. Data channel 12 connects pri- 

broadcasting and entertainment industries for the purpose of 4 o rnary data stream generation sub-system 10 and sequencer 

delivery to consumers over delivery mediums such as broad- 14 and data channel 19 connects it to data synchronizer 20. 

cast television, video cassettes, radio and audio CD's. The Data channels 12 and 19 may be initiated by a live video 

content of the primary data stream is typically created by feed, or analog or digital tape. Reference numeral 16 refers 

production studios for mass distribution to the consumer to an associated data generation sub-system. The output of 

market. Often a distributor produces all or part of the 45 associated data generation sub-module 16 is a digital signal 

programming content. For example, a local television news that is supplied over digital data link 18 to sequencer 14 and 

station obtains p re-produced video news and advertising over digital data link 17 to synchronizer 20. The digital data 

content from national providers and inserts locally produced links of the system may be a conventional digital connection 

content and advertising for broadcast. Equipment used in the such as a serial or parallel or it may be a network link, 

television industry are video cameras and video recorders. In 50 Typical connecting media would be twisted pair, co-axial 

radio, it is microphones and audio recorders. Typically, the cable, fiber optic cable or a wireless media, 

primary data is organized into programs. A primary stream Reference numeral 20 refers to a data synchronizing 

of data can be rendered intelligent to a consumer as either sub -system whose function is to synchronize the primary 

audio or video or a combination of the two. data stream generated by sub-system 10 with specific asso- 

The term associated data as used herein refers to a stream 55 ciated data. The input to data synchronizing sub-system 20 

of data generated separately from the primary data but is scene information from the primary data stream in the 

having content that is relevant to the primary data in general form of timecodes and time durations, and data from asso- 

and usually relevant to a particular program of primary data ciated data generator sub-system 16. It creates a so called 

and is in this sense associated. Associated data is intended to script for the delivery and display of associated data at 

enhance the utility of the primary data stream, but if it is not 60 specific points in time. For example, data synchronizer 20 

available, the primary data stream can stand on its own creates a script that specifies that a detailed data sheet will 

merits. The creation process typically uses commercially be delivered to the consumer prior to a specific television 

available software and hardware that output industry stan- product advertisement, and that the data sheet will be 

dard file formats such as Hypertext Markup Language displayed on the consumer's personal computer display 

(HTML) for text and graphic layout, Graphics Interchange 65 when a certain television advertisement starts. 

Format (GIF) Joint Photographic Experts Group (JPEG) Data synchronizer 20 typically includes software which is 

formats for still images, and so forth. patterned after common digital video editors such as Ado- 
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be's Premiere, which places parallel video and audio tracks atmosphere. Such transmitters may be television or radio 

on a standard time line such as SMPTE (Society of Motion broadcast transmitters or a satellite broadcast system. Also, 

Picture and Television Engineers) time code. This allows the data may be stored on a tape for later transmission, 

segments of each track to be manipulated independently but Reference numeral 34 generally indicates the equipment 

with reference to a common time line so that segments may s ^ must be nt at the consumer > s locatkm> In general> 

later be reconstituted The software of data synchronizer 20 34 fc & ier ^ { it has di ital compudllg 

allows associated data to be laid out and manipulated on an u-r* « * * 7i • j 

™ . r .i . capability as well as equipment to receive the primary and 

additional data track. The size of particular associated data •. J j* i» • u u i 

, 1 . 1 . r i associated data streams. Receiver 36 could be a personal 

components is coordinated with the known bandwidth of the . « . , t , A . , . . , , 

j !• j- m. rj . ...... „ computer add-in adapter board, a television or radio broad- 

delivery medium. The user of data synchronaer 20 typicaUy l0 casl * ecei a cab i/ le levis>on converter box or it could be 

specifies that a unit of information should be displayed at a a for bt0idc3St In ^ ferred 

specific point in time Data synchronizer 20 then calculates embodiment ^ it j, a broadcast te]evision receiver or tuner 

the time required to transfer the data and inserts a transfer . . , e , * o * j * • • 

^ • * * a * . .... inside of a personal computer. Connected to receiver 36 is a 

specification into the script at the appropna to point pnor to micr rocessor 38 . connected to microprocessor 38 is 

t ? y -,n ^ D -.? e °T f synchronizer 15 mem0 ry 40 which would typically be semiconductor RAM. 

sub-system 20 ■ a digital signal representing a script that Additional tic media such as a hard ^ would be 

synchronizes the output of primary data stream sub-system dMlt Microprocessor 38 k C0Dnecte d to human inter- 

10 and associated data stream generator 16. c A ~ , . 4 . „ ™ T . , 

& face 42, which is typically a CRT monitor, and to printer 44. 

The output of data synchronizer 20 is supplied over digital Human interface 42 and receiver 36 could be part of a 

data link 22 to sequencer sub-system 14. Digital data link 22 2 o standard television 

is a conventional digital link. Sequencer 14 combines the „ - * - - , it _ , , . , 

j . , . iL iL • * j j * c j i_ Reference numeral 32 refers to the delivery media which 

primary data stream with the associated data as specified by ( , . r i « 

f, J . . i- j i_ . • . 4 -i/ in this case are radio frequency electromagnetic waves 

the script supplied by synchronizer sub-system 20. i( _ , 7 ; rtL , 6 ,. . 

o 1 .i •* *u * * r • j iA passing through the atmosphere. If the delivery media is a 

Sequencer 14 monitors the output from primary data stream , , « a ^.u . in 

r . in . u* ■ *u ■ * *■ * video tape, laser disk or audio CD, then, transmitter 30 

sub-system 10 to obtain the information necessary to 9 c « -j * j -j J* ,™ j 

^ , .- e -.jj.i- i becomes a video tape recorder, video or audio CD recorder, 

sequence transmission of associated data. For example, , . ajC , r , ' . A . , . 

, . , j . r . t . • , . r and receiver 36 becomes a VCR, laser disk player or an 

during the broadcast of a television program, data sequencer au( j[ 0 Q) ] a er rcs cctivel 

14 obtains a time code information such as SMPTE time P / P /• 

code which is generated by the primary data stream. The J FI p' 3 15 a hl & le f * ^, lo f dia ^ am showm S fu ^ r 

information is used to coordinate mixing of associated data 30 detaUs of svstem 34 of FIG - 2 * Referring D0W t0 FIG 3 » 

with primary data streams. In addition, sequencer 14 mixes receivcr 36 receives radio frequency waves from input 50. 

other data feeds that are being transmitted over the same Receiver 36 demodulates the input signal and supplies the 

delivery medium. These may include external data services P rimar y data stream over data P ath 52 to P rimar y data 

such as financial data, emergency broadcast information or rendering sub-system 54 and the associated data signal over 

weather information. Mixing of existing data streams is 35 daU path 56 t0 assocxated data decoder 58 * 
necessary only for delivery mediums that don't support Primary data rendering sub -system 54 performs the func- 
separate, independent transmission of digital information. | ion of presenting the primary data stream to the consumer 
This function has the capacity to be used for the delivery of m me manner in which a typical consumer would expect to 
either live or pre-recorded programming, or a combination see tne data presented. For example, in the case of television, 
of both. For live programming, such as a local evening news 40 me primary data rendering takes the form of a video image 
program, the data stream sequencer takes input directly from typically supplied by a cathode ray tube screen, or possibly 
the outputs of primary data stream generator 10, data syn- a ^quid crystal display screen and audio provided by an 
chronizer 20, associated data generator 16, and time code audio amplifier and speakers. In the preferred embodiment 
from the primary data stream. For pre-recorded lhese components are in a personal computer. A second 
programming, this function processes the output of the data 45 example is a broadcast radio demodulator, amplifier and 
synchronizer 20 and sequences the broadcast of associated speakers that renders radio waves received via radio broad- 
data with the primary data. casting audible to a consumer. Yet a third example is a stereo 
The output of sequencer 14 is supplied over conventional svslem that Anders data encoded on compact disk or tape 
digital data link 24 to encoder 26. Encoder 26 is a hardware audible t0 the consumer. 

component for insertion of digital information into the 50 Decoder 58 performs the function of decoding the asso- 

p articular delivery medium that will be received by the ciated data from the delivery media. In this case decoder 58 

consumer. If the delivery medium is broadcast television, consists of an analog to digital converter that converts 

encoder 26 inserts this information directly into the NTSC analog encoded digital data back to digital format, 

television signal, and thus delivers both the primary and Associated data protocol manager 60 is connected by 

associated data over a single delivery medium, broadcast 55 one-way data path 62 to decoder 58 and by one way data 

television radio waves. Encoder 26 accepts input streams of path 64 to communications manager 66. Associated data 

both video and serialized digital information. It breaks the protocol manager 60 performs the function of extracting the 

serialized digital information up into a series of packets, and different forms of associated data from the incoming digital 

modulates the packets into the (" VBI") of the video signal. data steam and converting them to a form that can be used 

Encoder 26 is commercially available hardware and soft- eo by communications manager 66. The types of associated 

ware. A number of vendors market hardware for insertion data protocols include World Wide Web pages, closed 

and extraction of data into and from standard (NTSC/PAL) captioning, stock quotes, sports scores, control commands 

television signals. Norpak Corporation, EEG, Inc, and for microprocessor 38 (of FIG. 2) to execute. 

WavePhore, Inc. are examples. Communications manager 66 performs the function of a 

The output of encoder 26 is supplied via digital data link 65 common network interface by receiving data from several 

28 to transmitter sub-system 30 which performs the function different types of communication devices using different 

of physically transmitting radio frequency waves into the data transmission protocols. Such devices include telephone 
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modems, ISDN modems, cable modems, wireless modems, 80. At any time, the consumer may browse the data stored 

satellite modems, broadcast TV, radio and the like. Com- in local datastorage. This data will have been professionally 

munication manager 66 converts all data received, regard- selected to provide an enhanced viewing experience. For 

less of the source and protocol, into a standard format that example, difficult to find data sources providing historical 

can then be utilized by the rest of the system. This function S background to a program will have been previously 

may be implemented in one of two ways. Proprietary researched by the associated data provider and sent as 

interfaces between the communication components may be associated data. The human interface is user friendly and 

designed, or standard industry interfaces such as Microsoft ™ U a il ow the consumer to browse tamgh the associated 

Windows' (a trademark of Microsoft Corporation) sockets ? ata * This might start with a menu of available information 

may be used. The preferred embodiment uses Windows 10 from wh * ch thc CODSimier could sele 0 ct ^ as ' lf data W( * e 

sockets. A Windows socket is a standard application inter- comm S from an A ™ lmQ serv \ ce ' ^ < he data ^actually 

face to access network data. stored locall y- ^ 11 arnved in local stora S e b V bem S 

„ , . . . , . transmitted with the primary data stream. The consumer may 

Real time trigger 76 is connected to communications s , he assotilJeA data ^ a variet of includi 

manager 66 by one-way data path 78 and to human interface softi md relevant information . 

88 by data path 87. Human interface 88 provides the 15 „ T _ r j r j L 

J • * j it* *i« * i *u FIG- 4 is a block diagram of a second preferred embodi- 

consumer with input and output to the system. In the , t* . * A . . , . A r , . 

c j . ,. 4 . • * c oo *u i ment ot the invention that includes interactive communica- 

preferred embodiment, human interface 88 uses the key- _ c . , ^ T ^^ „ , t 

f . , u . . t , , / tions. Reference numerals common to FIGS. 2 and 4 refer- 

board and alternate input devices such as a mouse of a A . n c A ™~ A 

, . ■ t f , A iU A - ! t e nce the same matter. Refernng now to FIG. 4, a two-way 

personal computer as input for requests and the display of ... , * A£ • * j t • 

f, , r . r j * i ■ ii j i on communication channel 46 is connected to microprocessor 

the personal computer for displaying the data. 2U - c , . , . . t , r 4 

r t- r / & 3g and p r0V1 d es interactive access to remote computers over 

Real time trigger 76 accepts commands sent as part of the SUCD media ^ me analog telephone network, the ISDN 

associated data to display a page of information without the networ k, a wide area packet switched network such 

user asking for it. The output of realtime trigger is a as X25) frame re i a y or asynchronous transfer mode, 

command sent over data path 87 to human interface 88 FIG. 5 is a high level block diagram showing further 

which causes the page of information to be displayed. For dctafls of (he lem of FIG 4 Reference nilincra]s common 

example, a broadcaster may want viewers to see a certain tQ nGS 2 and 4 reference me same matter Referring now 

page of information as part of a program that is being lQ FIQ 5 remot£ daU m n fa coimected to human 

viewed. Real time trigger allows data to be displayed using g8 b data m 94 md {Q commuQications manager 

the same data protocols as consumer requested information. ^ by (wo _ way data path 96 Remote data managef n receives 

Local data storage 80 is connected to communications commands from human interface 88 to retrieve data from 

manager 66 by one-way data path 82 and by data path 83 to remote computers through two-way communications chan- 

local data manager 84. The hardware implementation for nc i 74 an d to send that data to human interface 88 for 

local data storage 80 may be one or more of the following; presentation to the consumer. 

RAM, disk, tape, recordable CD-ROM. ^ Network protocol manager 68 is connected by two-way 
Local data manager 84 is connected to communications data path 70 to communications manager 66 and by two-way 
manager 66 by data path 86 and to human interface 88 by data path 72 to two-way communication channel 74. Net- 
two-way data path 90. Local data manager 84 receives work protocol manager 68 performs the function of format- 
commands from human interface 88 to retrieve associated ting data received and transmitted over two-way communi- 
data from local data storage 80 and sends that data to human 40 cation channel 74. It contains the various protocols required 
interface 88 for presentation to the consumer. For example, to communicate with remote computers. Again, operating 
a "Web Browser" may be used to display data pages from the systems such as Microsoft's Windows typically provide 
World Wide Web (the "WWW"). Providers of WWW network protocol managers with plug in modules called 
browsers include Netscape Communications Corp., America drivers to support different protocols and different commu- 
Online, Spyglass and others. Local data storage 80 will 45 nication hardware. Network protocol manager 68 extracts 
typically be of limited capacity. Thus, local data manager 84 incoming data from two-way communication channel 74 
purges older and less used information. This is accomplished using a network protocol appropriate for the medium sup- 
by assigning an expiration date and/or a priority to associ- ported by two-way communication channel 74. Network 
ated data files. The criteria for determining which data to protocol manager 68 also encodes output data using the 
purge is settable by the broadcaster and/or the consumer. 50 appropriate protocol and passes the data onto two-way 
Criteria include total amount of storage available, size of communication channel 74 for transmission to third party 
associated data files, expiration date and priority. computers. 

The preferred embodiment illustrated in FIGS. 2 and 3 Two-way communications channel sub-system 74 pro- 
operates in the following manner. A primary data stream is vides the function of connecting the client system interac- 
generated. Associated data is separately generated. A script 55 tively to remote computers that may be server machines, 
is generated that synchronizes how the primary and associ- machines at online service providers, the Internet or inde- 
ated data are linked together. The primary data, the associ- pendent Bulletin Board Systems ("BBS"). The network to 
ated data and the script are sent to sequencer 14 where they which two-way communication channel 74 is connected 
are combined. The primary data is transmitted in the con- may be a conventional switched analog telephone system 
ventional fashion of its delivery medium. In the television 60 interfaced to a modem, a digital switched system such as 
model, this is broadcast over the air or on cable. The ISDN interfaced to an appropriate adapter card, a wide area 
associated data is generally (but not always) sent by the network connected through an access device, satellite 
same delivery medium as the primary data. In the case of technologies, and the like. A two-way communications line 
television, the associated data is encoded in the VBI of the is used to retrieve and access information that has only thus 
television signal. The signal is received by the consumer's 65 far been received by the client system in the form of 
equipment. The primary data stream is immediately ren- references, which are pointers to where the information 
dered and the associated data is stored in local data storage actually resides. 
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The addition of a two-way communication channel allows 
a consumer to also access online services. In this case, 
associated data may consist of references such as uniform 
resource locations ("URL") which arc WWW page refer- 
ences. Associated data may include references to Internet 
News Groups which are shared static messages grouped by 
topic which may be accessed. Associated data may also 
include references to Internet Relay Chat areas which are 
multi-person dynamic conversation streams that enable 
users to communicate by text messages. Or, associated data 
may include pointers to information on an online service 
such as America Online, Prodigy or Compuserve. Thus a 
menu may list several references. And by clicking on a 
reference, the system actually connects to and retrieves the 
referenced information from the appropriate source. 

Alternatively, the associated data may itself include not 
only pointers to information on various online services, but 
the actual information which the associated data provider 
has acquired from an online service or source and incorpo- 
rated into the associated data prior to its delivery to the 
consumer. For example, the associated data may contain 
actual Internet News Group messages related to the primary 
data stream. Thus, even if the consumer does not have a 
two-way communications channel or chooses not to use it, 
the invention provides the appearance and feel of an inter- 
active connection to remote sources of relevant information. 

The foregoing preferred embodiments are subject to 
numerous adaptations and modifications without departing 
from the concept of the invention. Therefore, within the 
scope of the appended claims, the invention may be prac- 
ticed other than as specifically described herein. 

What is claimed is: 

1. A system comprising: 

creation means for creating a primary data stream and 

associated data; 
one-way delivery means for delivering said primary data 

stream and said associated data in a single integrated 

signal stream from a network to a consumer; 
consumer location equipment comprising: 
means for receiving and separating said primary data 

stream and associated data; 
memory means storing said associated data, said means 

being connected to said receiving means; 
processing means connected to said memory means for 

accessing said stored associated data; and 
human interface means connected to said processing 

means for selectively interacting with said associated 

data. 

2. The system of claim 1 further characterized by a 
two-way communications channel connected to said pro- 
cessing means, said two-way communications channel being 
adapted to carry digital data in two directions. 

3. The system of claim 2 wherein said means for pro- 
cessing said associated data includes means for consummat- 
ing transactions over said two-way communications channel 
based at least in part upon said associated data. 

4. The system of claim 2 wherein said means for pro- 
cessing said associated data includes means for requesting 
additional data over said second channel of data based at 
least in part on information in said associated data. 

5. The system of claim 4 wherein said associated data 
includes data from an online service. 

6. The system of claim 5 wherein said means for deliv- 
ering said associated data is storage media. 

7. The system of claim 1 wherein said primary data stream 
and said associated data are communicated by the same 
delivery medium. 
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8. The system of claim 1 wherein said primary stream of 
data is audio only. 

9. A system comprising: 

a one-way delivery sub-system for delivering from a 
5 network to a consumer a combined data stream having 

a primary data stream that contains a plurality of 

programs and associated data that relates to one or 

more of said plurality of programs; 
consumer location equipment comprising: 
a receiver for receiving said combined data stream; 
a digital processor connected to said receiving means for 

separating said associated data from said combined 

data stream; 

15 memory storing said associated data, said memory being 
connected to said processor; 
a human interface connected to said memory means for 
accessing and selectively interacting with said stored 
associated data. 

20 10. The system of claim 9 wherein said one-way delivery 
means for delivering said combined data stream to said 
consumer is television. 

11. The system of claim 10 wherein said associated data 
is inserted into available unused bandwidth in said television 

25 signal. 

12. The system of claim 10 wherein said television is 
broadcast television. 

13. The system of claim 9 wherein said one-way delivery 
means for delivering said combined data stream to said 

30 consumer is radio. 

14. A system comprising: 

first creation means for creating a primary data stream; 
second creation means for creating associated data, 
35 first one-way delivery means communicating with said 

first creation means for delivering said primary data 

stream to said consumer; 
second one-way delivery means communicating with said 

second creation means for delivering said associated 
40 data to said consumer; 

consumer location equipment comprising: 
first means for receiving said primary data stream; 
second means for receiving said associated data stream; 
45 memory means storing said associated data; 

processing means connected to said memory means for 

accessing said stored associated data; 
a two-way communications channel connected to said 

processing means, sand two-way communications 
50 channel being adapted to carry digital communications 

in two directions; and 
a consumer interface connected to said processing means 

for interacting with said associated data. 

15. The system of claim 14 wherein said second one-way 
55 delivery means for communicating said associated data is a 

sideband carrier. 

16. The system of claim 14 wherein said second one-way 
delivery means for communicating said associated data is a 
cable television communications network. 

60 17. The system of claim 14 wherein said second one-way 

delivery means for communicating said associated data is a 

telephone line. 
18. The system of claim 14 wherein said means for 

processing said associated data includes means for request - 
65 ing additional data over said two-way communications 

channel and wherein said additional data is referenced by 

said associated data. 
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19. The system of claim 14 wherein said means for 
processing said associated data includes means for consum- 
mating transactions over said second channel of communi- 
cation based at least in part upon said associated data. 

20. The system of claim 19 wherein said associated data 
includes pointers to data in an online service. 

21. The system of claim 14 wherein said associated data 
includes data acquired from the Internet. 

22. The system of claim 14 wherein said associated data 
includes pointers to data on the Internet. 

23. The system of claim 14, wherein said associated data 
includes pointers to instructions and data on another com- 
puter to be executed by said processing means. 

24. The system of claim 14 wherein said primary stream 
of data is audio only. 

25. The system of claim 14 wherein said primary stream 
of data is a subscription digital audio service. 

26. A method comprising: 
generating a stream of primary data; 
generating a stream of associated data; 

combining said primary and associated data into a single 
data stream; 

delivering said combined data stream to a consumer; 
separating said associated data from said combined data 
stream; 

storing said separated associated data; 
displaying said accessed associated data; 
selectively interacting with said stored associated data 
using a computer. 

27. The method of claim 26 further including processing 
said associated data before the displaying thereof. 

28. The method of claim 27 further including storing said 
associated data in local non-volatile storage. 

29. The method of claim 28 wherein said processing said 
associated data includes sorting said associated data. 

30. The method of claim 29 wherein said processing said 
associated data includes categorizing said associated data. 

31. The method of claim 26 further including accessing 
remote computers based upon references included in said 
associated data. 

32. The method of claim 26 further including printing 
portions of said associated data. 

33. A system comprising: 

a primary data stream generator; 



20 



25 



30 



35 



an associated data stream generator; 
a data synchronizer; 

a sequencer having as inputs said primary data stream 
generator, said associated data stream generator and 
said synchronizer, said sequencer being adapted to 
generate a combination signal containing said primary 
data stream and said associated data; 

a delivery sub-system connected to the output of said 
sequencer for delivering said combination signal to said 
consumer; 

consumer location equipment comprising: 

a receiver for said combination signal; 

a decoder connected to said receiver for separating said 

associated data from said combination signal; 
a memory storing said associated data, said means being 

connected to said decoder; 

a processor connected to said memory for accessing said 
stored associated data; 

a human interface connected to said processor for dis- 
playing said associated data; and 

a two-way communications channel connected to said 
processor. 

34. The system of claim 33 wherein said human interface 
comprises a computer monitor and keyboard. 

35. The system of claim 33 wherein said associated data 
includes data acquired from an online service. 

36. The system of claim 33 wherein said associated data 
includes data acquired from the Internet. 

37. The system of claim 33 wherein said associated data 
includes pointers to data in an online service. 

38. The system of claim 33 wherein said associated data 
includes instructions and data to be executed by said pro- 
cessing means. 

39. The system of claim 33 wherein said associated data 
includes pointers to data on the Internet. 

40. The system of claim 33 wherein said associated data 
includes pointers to Internet News Group articles. 

41. The system of claim 33 wherein said associated data 
includes pointers to Internet Relay Chat forums. 

42. The system of claim 33 wherein said associated data 
includes pointers to World Wide Web pages. 
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